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(54) FILTER DEVICE AND DECODER USING IT 

(57)Abstract: 

PROBLEM TO BE SOLVED: To reduce mosquito noise and block distortion of blocked 
image data without increasing the circuit scale. 

SOLUTION: Input image data are sequentially fed to delay elements DL 302 to 305and 
a noted picture element is given to the DL 303. Difference absolute value calculation 
circuits 306 to 309 calculate the absolute value of a difference between a noted 
picture element value and each of two left/right picture element values respectively. 
Comparator circuits 31 1 to 314 allow switches 316 to 319 to select a corresponding 
picture element in the case of each difference < a threshold level and allow them to 
select a null in other cases. An adder 320 sums selected values and a divider 321 
divides the result of sum by the number of concerned picture elements denoted and 
selected by a counter 315. Thusmosquito noise is reduced. When the noted picture 
element is resident at a border of blocksa picture element counter 101 uses the 
switch 101 to select a larger threshold level from a register 102. Thusblock distortion 
is reduced. 



CLAIMS 



[Claim(s)] 

[Claim 1]in every direction — a filter device which is a filter device which performs 
noise rejection filtering using a local property of inputted image data which collected 
for every pixel of a prescribed numberrespectivelyand was blockedand is 
characterized by establishing a control means which changes filtering conditions 
accommodative in a block border. 



[Claim 2]in every direction — a difference value of a pixel value of a noticed picture 
element in inputted image data collectively blocked for every pixel of a prescribed 
numberrespectivelyand each pixel value of two or more pixels of the neighborhood 
with a difference value detection means to detectrespectively. A comparison means 
to compare with a predetermined threshold each difference value detected [ above- 
mentioned ]respectivelyA selecting means which chooses the comparison resulta 
corresponding pixel valueor a predetermined pixel value according to each comparison 
result of the above-mentioned comparison meansrespectivelyA calculating means 
which does division with the number of the above-mentioned corresponding pixel 
value as which each pixel value which the above-mentioned selecting means 
choseand a pixel value of the above-mentioned noticed picture element were 
addedand the above-mentioned selecting means chose the added resultA filter device 
provided with an alteration means which detects whether the above-mentioned 
noticed picture element is in a boundary of the above-mentioned blockand changes 
the above-mentioned threshold according to the detection result 
[Claim 3]The filter device according to claim 2wherein the above-mentioned selecting 
means chooses a pixel value corresponding according to a comparison result in case 
the above-mentioned difference value is below the above-mentioned threshold. 
[Claim 4]The filter device according to claim 2wherein the above-mentioned 
predetermined pixel value is zero. 

[Claim 5]The filter device according to claim 2 when the above-mentioned alteration 
means is [ the above-mentioned noticed picture element ] in a block borderwherein it 
enlarges the above-mentioned threshold. 

[Claim 6]The filter device according to claim 1 or 2 which decrypts data in which 
block compression encoding of the above-mentioned inputted image data was carried 
out. 

[Claim 7]A decoding device comprising: 

An input means which inputs image data by which collected two or more pixels and 
block compression encoding was carried out 

A decoding means which decrypts image data inputted by the above-mentioned input 
means. 

A filter means which filters image data decrypted by the above-mentioned decoding 
means using a local property. 

A control means which controls filtering conditions of the above-mentioned filter 
means accommodative in the above-mentioned block border. 

[Claim 8]The decoding device according to claim 7 controlling the above-mentioned 
control means to carry out filtering more strongly than usual when a pixel filtered by 
the above-mentioned filter means is in a block border. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]This invention relates to the filter device for removing the 

noise of the blocked image dataand the decoding device using it. 

[0002] 

[Description of the Prior Art]The orthogonal-transformation-encoding method is 
known as art which carries out compression encoding of the picture signal highly 
efficiently. After this blocks a picture signal collectively for every predetermined pixel 
numberit performs orthogonal transformationsuch as a discrete cosine transform 
(DCT)and performs quantizationentropy code modulationetc. to the coefficient after 
conversion. 

[0003] Drawing 3 shows the coding and decoding device which used above-mentioned 
DCT as an example of block coding. In drawing 3f rom the input terminal 701 the 
digitized image data is inputted and it is blocked by the blocking circuit 702 by a mxn 
pixel unit. The image data blocked by the mxn pixel unit is outputted to the motion 
decision circuit 703 and DCT circuit 704. A corresponding block judges the block of a 
moving image areaand the block of a still picture fieldand outputs the motion decision 
circuit 703 to DCT circuit 704 as motion information on a block of a decision result 
DCT circuit 704 carries out orthogonal transformation of the blocked image data to a 
DCT coefficient. At this timeDCT circuit 704 switches processing of DCT 
accommodative using the motion information from the motion decision circuit 703. 
[0004]The data and the motion information on a corresponding block which were 
changed into the DCT coefficient are inputted into the quantization circuit 705and a 
DCT coefficient is quantized by a block unit. Quantization is performed by dividing a 
DCT coefficient by a quantization coefficient. 

[0005]It moves with the quantized dataand it is coded by techniquessuch as entropy 
code modulationin the variable-length-coding circuit 706and information and a 
quantization parameter obtain a desired data transfer rate. The coded data is 
outputted with the output terminal 707and after the formatting which was suitable for 
the transmission line or the recording medium in the latter circuit is madeit is 
recorded on transmission or a recording medium. 

[0006]At the time of decodingafter the data transmitted or reproduced from the 
recording medium is inputted into ECC circuit 709 from the input terminal 708 and 
correction of a digital error is performedit is decoded by the variable length code 
decoder circuit 710. Based on a quantization parameterinverse quantization of the 
decoded data is carried out in the inverse quantizing circuit 71 land it is changed into 
a DCT coefficient. At this timethe inverse DCT circuit 712 performs reverse DCT 
processing based on motion informationchanges a DCT coefficient into image dataand 
writes it in the frame memory 713. Since processing of quantization and inverse 



quantization is performed in the quantization circuit 704 and the inverse quantizing 
circuit 710the digital image data written in the frame memory 713 contains the noise 
by a quantization error. For this reasonafter performing filtering processing for noise 
mitigation in the filter circuit 714 and attenuating a noise componentit is outputted 
from the output terminal 715 and displayed on a monitor etc. The noise by the above- 
mentioned quantization error is divided roughly into two kinds such as the mosquito 
noise which appears near edgeand the block distortion which appears in a block 
border. 

[0007] Drawing 4 is an example of composition of the filter aiming at mosquito noise 
mitigation. The reproduced digital image signal is inputted in order of a raster from the 
input terminal 301. DL302DL303DL304and DL305 are delay elementsand perform 1 
pixel of delayrespectively. The noticed picture element which filters is stored in 
DL303and the pixel on the right of [ 2 pixel ] a noticed picture element is inputted 
into the input terminal 301 on a screenThe pixel of the 2-pixel left is stored in the 
pixel of the 1 -pixel leftand DL305 DL302 the pixel of the 1 -pixel rightand DL304and it 
has become a filter of level 5 taps. In the difference absolute value calculation circuits 
306-309the difference absolute value of a noticed picture element and 4 pixels of its 
right and left is calculatedand the result is inputted into the comparators 31 1- 
314respectively. The threshold for filter pixel selection is inputted into the input 
terminal 310and the comparators 311-314 output "T'when the inputted difference 
absolute value is below a thresholdand when that is not rightthey output "0." 
Thereforethe result of the comparators 31 1-314 is inputted into the counter 315and 
the number of the comparator which outputted "1" is counted. The counter 315 will 
hold the number (except for a noticed picture element) of the pixel used for filtering. 
[0008jThe comparison result of the comparators 31 1-314 chooses #1 sidewhen it is 
inputted into the selecting switches 316-319 and "1" is inputtedand when "0" is 
inputtedit chooses #0 side. Thereforewhen the selecting-switch 316 to 31 9#1 side is 
chosenthe value of each pixel is outputtedand "0" is outputted when #0 side is 
chosen. 

[0009]The output of the selecting switches 316-319 and the pixel value of the 
noticed picture element from DL303 are inputted into the adding machine 320and 
addition is performed, the number of the pixel which the number (except for a noticed 
picture element) of the pixel used for filtering from the counter 315 is inputted into 
the divider 321 and uses the added result of the adding machine 320 by filtering 
eventually — it is (the above-mentioned number+1) — it divides and outputs to the 
output terminal 322. The noise of the low amplitude below **th is reduced by the 
above compositionand it operates as a mosquito noise mitigation filter. 
[0010] 

[Problem(s) to be Solved by the Invention]In the above filter constitutionalthough 
there was the mosquito noise mitigation effectthe filter of another technique for block 
distortion mitigation needed to be usedand there was a problem that circuit structure 



increased. 

[001 1]An object of this invention is to obtain the filter device which can reduce the 
noise which solves the above problemsand from which it was beneficial and 
charactersuch as a mosquito noise and block distortiondiffers without increasing 
circuit structureand the decoding device using it. 
[0012] 

[Means for Solving the Problem]in every direction in an invention of claim 1 — it is a 
filter device which performs noise rejection filtering using a local property of inputted 
image data which collected for every pixel of a prescribed numberrespectivelyand was 
blockedand a control means which changes filtering conditions accommodative in a 
block border is established. 

[001 3]in every direction in an invention of claim 2 — a difference value of a pixel 
value of a noticed picture element in inputted image data collectively blocked for 
every pixel of a prescribed numberrespectivelyand each pixel value of two or more 
pixels of the neighborhood with a difference value detection means to 
detectrespectively. A comparison means to compare with a predetermined threshold 
each difference value detected [ above-mentioned ]respectivelyA selecting means 
which chooses the comparison resulta corresponding pixel valueor a predetermined 
pixel value according to each comparison result of the above-mentioned comparison 
meansrespectivelyA calculating means which does division with the number of the 
above-mentioned corresponding pixel value as which each pixel value which the 
above-mentioned selecting means choseand a pixel value of the above-mentioned 
noticed picture element were addedand the above-mentioned selecting means chose 
the added resultlt detected whether the above-mentioned noticed picture element 
would be in a boundary of the above-mentioned blockand an alteration means which 
changes the above-mentioned threshold according to the detection result is 
established. 

[0014]An input means which inputs image data by which collected two or more pixels 
and block compression encoding was carried out in an invention of claim 7A decoding 
means which decrypts image data inputted by the above-mentioned input meansA 
filter means which filters image data decrypted by the above-mentioned decoding 
means using a local propertyand a control means which controls filtering conditions of 
the above-mentioned filter means accommodative in the above-mentioned block 
border are established. 
[0015] 

[Function] According to the invention of claim 1the noise from which charactersuch as 
a mosquito noise and block distortiondiffers in a single filtering circuit is 
simultaneously mitigableand circuit structure does not increase. 

[0016]According to the invention of claim 2by usualfiltering which reduces a mosquito 
noise is performedand when a noticed picture element is in the boundary of a 
blockfiltering which a threshold is changed and reduces block distortion is performed. 



[0017]The noise from which charactersuch as a mosquito noise generated when the 
image data by which block compression encoding was carried out is decrypted 
according to the invention of claim 7and block distortiondiffers is simultaneously 
mitigable in a single filtering circuitThe image quality of the picture decrypted without 
increasing circuit structure is improved. 
[0018] 

[Embodiment of the Invention] Drawing 1 is a block diagram showing an embodiment of 
the invention. In drawing 1t he portions which attached the same numbers 301-322 as 
drawing 4 are identical parts as substantially as the portion in drawing 4 . The pixel 
counter which 101 counts the input pixel from the input terminal 301 and judges 
whether it is a block borderthe shift register which doubles the threshold as which 
102 was inputted from the input terminal 310and 103 are selecting switches which 
choose a threshold according to the value of the pixel counter 101. 
[0019]Nextoperation is explained. The reproduced digital image signal is inputted in 
order of a raster from the input terminal 301. Delay element DL302DL303DL304and 
DL305 perform 1 pixel of delayrespectively. The noticed picture element which filters 
is stored in DL303and the pixel on the right of [ 2 pixel ] a noticed picture element is 
inputted into the input terminal 301 on a screenThe pixel of the 2-pixel left is stored 
in the pixel of the 1 -pixel leftand DL305 DL302 the pixel of the 1 -pixel rightand 
DL304and it has become a filter of level 5 taps. The pixel counter 101 counts the 
pixel inputted from the input terminal 301 and judges whether the pixel stored in 
DL303 is a pixel of a block border. For examplethe horizontal position of an input pixel 
is counted and it judges whether it is a pixel on the horizontal boundary of a block. In 
the difference absolute value calculation circuits 306-309the difference absolute 
value of a noticed picture element and 4 pixels of its right and left is calculatedand 
the result is inputted into the comparators 31 1-314respectively. 
[0020]The threshold for choosing the pixel used for filtering is inputted into the input 
terminal 310. The threshold data from the input terminal 310 and the data of the 
threshold which it doubled via the shift register 102 are inputted into the selecting 
switch 103. The selecting switch 103 is controlled by the pixel counter 101 when the 
noticed picture element stored in DL303 is a pixel of a block borderit chooses #2 
sideand when that is not rightit chooses #1 side. 

[002 1]A threshold is inputted into the comparators 31 1-314 from the selecting switch 
103when the inputted difference absolute value is below a thresholdlis outputtedand 
"0" is outputted when that is not right. The result of the comparators 311-314 is 
inputted into the counter 315and the number of the comparator which outputted "1" 
is counted. Thereforethe counter 315 will hold the number (except for a noticed 
picture element) of the pixel used for filtering. 

[0022]The comparison result of the comparators 311-314 chooses #1 sidewhen it is 
inputted into the selecting switches 316-319 and "1" is inputtedand when "0" is 
inputtedit chooses #0 side. Thereforewhen the selecting-switch 316 to 31 9#1 side is 



chosenthe value of each pixel is outputtedand "0" is outputted when #0 side is 
chosen. 

[0023]The output of the selecting switches 316-319 and the pixel value of the 
noticed picture element from DL303 are inputted into the adding machine 320and 
addition is performed, the number of the pixel which the number (except for a noticed 
picture element) of the pixel used for filtering from the counter 315 is inputted into 
the divider 321 and uses the added result of the adding machine 320 by filtering 
eventually — it is (the above-mentioned number+1) — it divides and outputs to the 
output terminal 322. 

[0024]By the above compositionwhen a noticed picture element is a pixel of a block 
borderThe threshold which the comparators 31 1-314 use will be the twice at the time 
of the usual mosquito noise removalfor this reasona more powerful filter is applied and 
both a mosquito noise and horizontal block distortion can be reduced simultaneously 
in a block border. 

[0025] Drawing 2 is a figure showing a 2nd embodiment of this invention. This 
embodiment is an example of the two-dimensional filter of 3x3. In a figurethe input 
terminal of regenerative dataand 202-209 201 A delay elementThe difference absolute 
value calculation circuit of the noticed picture element and adjacent pixel in which 
210-217 filterThe pixel counter which 218 counts an input pixel and judges whether it 
is a block borderThe threshold table which stores the threshold which uses 219 for 
pixel selectionA comparator [ absolute value / difference / threshold / 227 / 220- 
]the counter for which the number of the pixel which 228 uses for filtering is 
countedThe selecting switch which chooses the pixel value which 229-236 use for 
filteringthe adding machine with which 237 adds the selected pixel valuethe divider 
with which 238 equalizesand 239 are output terminals. 

[0026]Nextoperation is explained. Regenerative data is inputted into the input terminal 
201 in order of a raster. The inputted pixel value is delayed by DL 202-209 one by 
one. When the noticed picture element which filters to DL205 is storedThe pixel value 
at the lower right of a noticed picture element is inputted into the input terminal 201 
on the screenTo DL202the pixel value under 1 pixel DL203 a lower left pixel 
valueDL204 — the pixel value of the 1 -pixel right — DL206 — the pixel value of the 
1 -pixel left — as for the time delay of each delay elementthe upper right pixel value 
is set as DL207 so that the pixel value on 1 pixel may be stored in DL208 and an 
upper left pixel value may be stored in DL209respectively. In the case of NTSC 
systemthe pixel under one line of an identical field is inputted or stored in the input 
terminal 201 and DL202and DL203 for the pixel value on one line of an identical field 
to the noticed picture element at DL 207-209. 

[0027]The difference absolute value calculation circuits 210-217 calculate the value 
of DL205 which is a noticed picture elementand the difference absolute value of each 
eight pixel which adjoins it. The pixel counter 218 counts the pixel inputted from the 
input terminal 201 and judges whether the noticed picture element stored in DL205 is 



a pixel of a block border. For examplean input pixel is leveland a vertical position is 
countedand it judges whether it is a pixel on the boundary of level or the 
perpendicular direction of a block. 

[0028]The threshold which is used in the case of a block boundary pixeland the 
threshold which carries out normal use are stored in the threshold table 219and the 
threshold outputted by the decision result of the pixel counter 218 is chosen. The 
contents of the table are the tables which have a bigger value than the threshold 
which carries out normal usefor example in block boundary pixels. 
[0029]A threshold is inputted into the comparators 220-227 from the threshold table 
219and a difference absolute value is inputted from the difference absolute value 
calculation circuits 210-217respectively. When the inputted difference absolute value 
is below a thresholdlis outputtedand when that is not rightOis outputtedrespectively. 
The result of the comparators 220-227 is inputted into the counter 228and the 
number of the comparator which outputted "1" is counted. Thereforethe counter 228 
will hold the number (except for a noticed picture element) of the pixel used for 
filtering. 

[0030]The comparison result of the comparators 220-227 chooses #1 sidewhen it is 
inputted into the selecting switches 229-236 and "1" is inputtedand when "0" is 
inputtedit chooses #0 side. Thereforewhen the selecting-switch 229 to 236#1 side is 
chosenthe value of each pixel is outputtedand "0" is outputted when #0 side is 
chosen. 

[0031 ]The output of the selecting switches 229-236 and the pixel value of the 
noticed picture element from DL205 are inputted into the adding machine 237and 
addition is performed, the number of the pixel which the number (except for a noticed 
picture element) of the pixel used for filtering from the counter 228 is inputted into 
the divider 238and uses the added result of the adding machine 237 by filtering 
eventually — it is (the above-mentioned number+1) — it divides and outputs to the 
output terminal 239. 

[0032]By the above compositionwhen a noticed picture element is a pixel of a block 
borderSince the threshold for block boundary pixels is chosen from a threshold tablein 
a block bordera more powerful filter is applied and a mosquito noise and the noise of 
both block distortion of level and a perpendicular direction can be reduced 
simultaneously. 
[0033] 

[Effect of the Invention]As mentioned aboveby changing a filter condition 
accommodative in a block borderwhen performing noise rejection filtering using the 
local property of a reproduced image signal according to the invention of claim 1The 
noise from which charactersuch as a mosquito noise and block distortiondiffers 
effectively is simultaneously mitigableand increase of circuit structure can be 
suppressed. 

[0034]According to the invention of claim 2both noises can be reduced 



simultaneouslywithout increasing circuit structuresince the circuit for mosquito noise 
mitigation is sharable with the circuit for block distortion mitigation. 
[0035]The noise from which charactersuch as a mosquito noise generated when the 
image data by which block compression encoding was carried out is decrypted 
according to the invention of claim 7and block distortiondiffers is simultaneously 
mitigable in a single filtering circuitThe image quality of the picture decrypted without 
increasing circuit structure is improved. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is a block diagram showing an embodiment of the invention. 
[Drawing 2] It is a block diagram showing a 2nd embodiment of this invention. 
[Drawing 3] They are the conventional coding and a block diagram of a decoding 
device. 

[Drawing 4] It is a block diagram of the conventional filtering circuit. 
[Description of Notations] 

The input terminal of 301 and 201 regenerative data 
302-305202-209 Delay element 

306-309210-217 Difference absolute value calculation circuit 
310 The input terminal of a pixel selection threshold 
311-314220-227 Comparator 
315228 counter circuits 
316-319229 - 236 selecting switch 

320 and 237 Adding machine 

321 and 238 Divider 
101218 pixel counters 

102 Shift register 

103 Selecting switch 

322 and 239 Output terminal 
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